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Video codec and method for encoding video frames 
Technical Field > 



T fe^^ g^cijion relates to the field of video codecs. In particular, the invi^ntion 
concerns jdte comparison of image firames in a video codec. 

Background 




are used to prepare video image firames for transmisMonl^lK^^ 
of this description, Video' will be used to mean motion vid^^p^^* 
-y ^^ga med to describe a sin^e image. ^ ■ ,^ i : v^^^^ 



Co^^g^al JPEG video compression does not enable exploiting the time 
^g^smpy in the compresa^on of Addeo sequences. £!ach firame in th9 v^te^ : 
gjggC^Qj^^compressed independently firom its neighbotirs in time. ^ 



Sf^^v^^ rnodem video codecs compare consecutive video fi-ames.^lip^^c^ 
on|^ the difference between the present frame and the previous frame. La 9 
videB^^ naangsion system, such selective encoding reduces the anfeS^pf : 
inf^rpiat^ must be transmitted. This encoding is referred td^M^ 



document, Discrete Cosine Transform (DCT) based videp 
^PC^ unless stated otlierwise. In these cpdec«t |l^fi^ci^ T 
divid^[4^pblocks of fixed size. These blocks consist generally of 8x8 or 16x16 \ 
pi3c^grEa^ block is compressed separately in video standards such as jp'EG- J 
tH^S^ff, H.261, and otiiers based on this principle. ^ ! 

A;^^^??^**^ carries out video compression is commonly ti^gg^^^j g^ ^.- 
eiM^d^r^DQgila^ a video codec whidi carries out video de-compr^So^^^^^ 
crgpEBW^^jSte^^ a decoder. . .^-^^ 
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Simple codecs use an on-oflf techiuque for the encoding. This technique involves 
comparing corresponding blocks of consecutive images and if they are similar 
then the latest block is not encoded. Instead the system generates and 
5 transmits information to the effect that this block is a dupUcate of the 

corresponding block from the previous frame. If however the latest block is 
sufficiently different from the corresponding block of the earlier image, then the 
block concerned is encoded as is. 

10 This 'on-oflP diEFerential video compression is illustrated in figure 1. 

Figure 1 shows the generic block diagram of a video compressor based on DCT 
and implementing on-off differential encoding technique. Each block from the 
present firame is compared to the most recently encoded corresponding block 
15 firom a previous frame. The most recently encoded block from a particular 

position in the frame and its frame will be referred to as the ^previous block' and 
'previous frame' respectively. These will only be from the immediately 
preceding frame when the corresponding block in that frame was in fact 
encoded. 

20 

The comparison performed by the arrangement of figure 1 is performed in 
Hmage space*. This means that the comparison is performed between data 
concerning the latest image frame, which has not yet been processed for 
transmission, and data from the previous image frame, which has both been 
25 processed for transmission and then also processed back into its original 
format. The decision whether or not to encode a block of a video frame is 
therefore made by comparing two portions of images themselves. 

If the present block and the previous block are similar, then the output of the 
30 encoder is a signal indicating that no encoding of the present block will take 

place. This has been shown in figure 1 as a 'Skip' block. This signal may consist 
of a single byte of data. Obviously transmission of this byte in place of the code 
for an entire block reduces the requirements, particularly for bandwidth, on 
circuitry and transmission paths downstream of the codec. 
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H^^ever, if corresponding blocks in the present and previoxisly ed^^^^m^e 
are not then the present block must be encoded! The present hljKk is 

: '^^/prsmformBd by the element marked DCT, the restiltant coefiE^tteiT^ are 
5 quantise by element Q, and the quantised coefficients are compressed using 
^ . element E. This entropy compressor mayin i^ct 

i | ^fcSd# r lossless encoding steps such as nm-length coding, Huffin£ai a>ding 

10 l^ficpis^ carried out by the 'compare' block in figure 1 is made 1$ j^er 
to-^decide wjtietiier or not to encode a particular block of the latest image. This 
o^^gaxi^m must be done in image space when motion estimation 'r^^'x^. ". 
c^p^c]|sation is used in the compressor. This is the reason why the 
^^d^^ng^K^ of figure 1 converts the block of the previous comj^^^^^ 

15 ^l^llipD^u^ space. The elements IDCT and Q"^ are employed to do 

iSfeiaent IIX3T provides an inverse DCT transform of tlie coefficients wM(^ 
ai^ ic^tit to it. Element Q** is a de-quantiser. Together elements IDCT and Q"' 
(C^istitute a partial decoder. - > ^ 

are however encoding arrangements where motion compressi<m^cem.be 
oM^b^.^ these cases it is not necessary to perform the cpmpari]»m^6f ix^ 
blQf^ ip ipage space. Instead the comparison can be performed in DCT - 
cMffiaentjSpac^ also referred to as the DCT ^domain'. To perform «lu«ife#^^ 
c»Qp^)jiy^^ it is not necessary to perform an inverse DCT opera^qp bn the 
25 Ci^fficients of the previous block. An arrangement for on-oflf differential yideo 
cq^resMon in the DCT domain is shown in figure 2. 

J^^pda^ between figures 1 and 2 are that: 

(i) ^In the arrangement of figxire 2, the compressed previous image blockis.in 
30 I^^j Bteigaen^ space when the comparison is made between the lcy^ 

i^^p^eKripus blocks; 

(ii) lii the sgi^^ " 
(iu)'The airangement of figure 2 does not include an IDCT element for- 
pcaibjm an inverse DCT transformation in the decoding branch. 
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Function of the comparators 

The function of the comparator of figure 1 is to compute the energy of the 
5 differences between a block firom the present iBrame and the corresponding 
block firom the previoxis firame, in image space. If the energy diflFerence is not 
computed, then the 'compare' block must calculate the difference in a similar 
variable between the two blocks. The comparator in figure 2 performs the 
same computations in DCT coefficient space. 

10 

Summary of the Invention 

A video compressor (DCT; Q; E) in accordance with the invention comprises 
means for comparing present and previous video frames, whereby the means 
15 for comparing are adapted to make the comparison in quantised (DCT; Q) 
coefficient space. 

In accordance with a preferred embodiment of the invention, the video 
compressor (DCT; Q; E) comprises an entropy decoder (E*^) for providing the 
20 data concerning the previous fi:'ame in quantised (DCT;Q) coefficient space. 
The video compressor may comprise transform means (DCT) for appl3dng a 
DC!T transform to blocks of the video frames and quantising means (Q) for 
converting the output of the transform means into coefficients in quantised 
space. 

25 

A video transmission system (JPEG) in accordance with the invention may 
comprise a video compressor (DCT; Q; E) in accordance with any of the above 
embodiments and a data transmitter for transmitting the compressed data. 

30 A method of video compression (DCT; Q; E) in accordance with the invention 
may comprise comparing present and previous video frames, whereby the 
comparison is made in quantised (DCT; Q) coefficient space. 
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^fifficimrdance with a preferred embodiment of the invention^ the iiiethM^^ 
vidj^xodo^^ may comprise the istep of providing the data in quantised 
ccppScieni space concerning ttie present firame by entropy decodixig (E'!)il A 



jpN^tgre^ (DCT) may be applied to blocks of the video firames^liiiulr'^e 
5 ffS^^^^^ie transfonning step may be quantised (Q) into coefficietits iir 
' qii^^sed'Bpace. • . .-r- i^f^S^- ^ 

, . A^^tlu^fi^f v^ transmission (JPEG) in accordance with the invefit^iQ^rZXiay 
- cd^i^se performing video compression (DCT; Q; E) in accordance wiS|im^ of 
10 thn^^^hods cutHned above and taransmitting the compressed data:: ^ v 

^^^7^^^ Brief description of the drawings 



K^^ jldtiows a prior art arrangement for performing 'on-ofP differep^jEd^yideo 
15 CG^presisioii in image space; " • 



_2rihbws an arrangement for performing 'on-off differential vidieo : - 
c^S^^^aSon in the DCT domain; 



20 shows an arrangement for performing *on-off differential video 

cc^Q^re^mln accordance with the invention; 



F^^^jshows an arrangement for performing *on-off differential video ^ 
ccQ^r^isioh in pre-dequantisation DCT domain in accordance wi&ii^S 
25 in^^on, together with a complete JPEG compression sye^tem. 



Detailed description of the oreferred e mboariiient 



T^^d^zjraHxijp^^ presented in figures 1 and 2 necessitate the exi^l^ce of 
30 eitlier fuU j^^^ decoders in the backward path of the compre^i^ side. In 

figign^^itfe^^ is performed by the elements Q"^ and IDCT. In figure 2 

tbiskde^ is performed by element Q"* . Without such decoding, tfie 
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xoformation in the previous frame woiild not be in the same 'space' as the ' 
inforaiation about the present frame with which it must be compared. 

However, in an arrangement in accordance with the invention the backward 
5 path can be simplified even further, to become only a null operation. To do this, 
the structure of the compressor is as in Figure 3. 

In the arrangement of figure 3, the compressed previous frame is saved in the 
pre-dequantization DCT coefi&cients space. Consequently, all blocks of the 
10 present frame pass the DCT and the quantiser Q before the comparison. The 
movement of the quantizer to this new position enables the removal of the 
inverse quantizer Q'\ As a resvilt, the backward path of the compressor does 
not involve any operation at all. v 

15 In Figure 3 the compressed previous frame is in pre-dequantization DCT 
coefiBcients space. Since the step of quantising introduces error, the 
comparison to be done in Figure 3 is not identical to that done in either figure 2 
or figure 1. To see the distinction, in the following, the sum of absolute 
difference SAD will be used as the comparison measiare. 

20 

In Figure 2 the SAD of an 8x8 block is calculated according to the following 
equation: 

7 7 

25 SAD = S S \c.(t) - q^e,j (t-l)\ (Equation 1) 

i^O j^O 

where: 

i and j are index numbers of the pixel; 
30 (t) is the DCT coeflBLdent for the pixel ij of the present firame; 
is the quantization step; and 
e^ (t-l) is the pre-dequantization value of the corresponding coeflBdent for the 
previous frame. 
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MMgure 3 the SAD per block is calculated according to the following e^qaatibn: 



iSib? = Z E |ej^r<; -€y r«-i; I (Equation 2) 

5. ..:;^T:. i = 0 j = 0 . .. . .--.,;r 



Si^S^ IS the pre-deqtiantization SAD. The absolute value tenii M eq^^ 
^ca^|« multipEe and divided by g. 



V 



10 'f^'^:i- 7 7 

^SAiy= 2 Z (l/qiy)| ■ j; I (Equina) 

Uem^ r^is the dequantised DCT coefi5cient. 

Tl^re aref ti^ main differences between equations 1 and 3, The first difference 
is tte^^ For unbiased 

qd^pt^era the average error between original and quantisedivalues is zero. 

20 s ^I^^ important, difference results Srom the weighing &ic(^ 

at ffie ^>eginning of equation 3. If the value of the quantization step takes 
l ar g ffl^ y ^^ as the spatial firequency increases, we observed that^ in SAD*, 
md^ importance is given to low firequency coefficients. This is the main 
dq^^^^hetweenSAZy . 

However, the human visiial system is more sensitive to lower spatial : 
frequencies, so the weighing in equation 3 should not degrade the perfonqq^^ 
ofel^^comparison. As evidence of this, simulations have shown tfaSt the 
degradatioa in performance is negligible. The result is that the vignaiqiiaViiy of 
30 eath^^e compressed images, according to both schemes, is almost the 
same:^;^:^.i.^•^^:• 



A^O^tiSWPt^ the innovation suggested in figure 3 becomes dear when a 
dosed tmipression engine (JPEG engine) is available and on-off differential 
35 co(£ggis required ..... : , ^ 
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For this case, the complete block diagram of an arrangement in accordance 
with the invention is shown in Figure 4. The blocks DCT, Q and E represent 
the JPEG compressor. This compression engine does not allow access to any 
5 intermediate connection point. Hence, the pre-dequantization DCT coefficients 
are obtained only by applying an entropy decoding operation. This operation is 
carried out by the block marked E"^ in figure 4. The comparison between the 
present and previous image blocks is made according to equation 2. The result 
of the comparison affects two data paths. 

10 

In the arrangement in accordance with figure 4, if the blocks imder comparison 
are similar the skipping information is passed as the compressed data. Also, 
the corresponding block in the compressed previous firame is retained 
unchanged for the comparison. If however the comparison detects significant 
15 change then the output of the JPEG engine is passed as the compressed data. 
Also, the corresponding block in the previoiis firame used for the comparison 
step is updated by replacing it with the output of the entropy decoder E 

If the comparison had been done in the DCT coefficients space then, in addition 
20 to the entropy decoder, it would have been necessary to apply dequantisation. 
This additional operation would have added one multiplication operation per 
DCT coefficient. Therefore by applying the comparison on the pre- 
dequantization DCT coefficients all these multiplication operations are saved. 
This saving enables the use of less powerful hence cheaper computation 
25 devices. 

The apparatus in accordance with the invention can take many forms. A 
digital signal processor could be provided. However, a suitably programmed 
general purpose CPU could also carry out the steps of the invention. It is only 
30 necessary for the apparatus to have functional elements which can carry out 
the operations shown in figure 3. Typically the invention may be applied to an 
existing JPEG compressor as shown in figure 4. In this case, the apparatus 
must have fimctional elements capable of carrying out the entropy decoding 
step of element E"V 
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T^j&aiis^ the compressed data, transmission means are reqtdred Tjste:: 
tratiiimgsion means may be an RF modem or a line modem. The ea^iact choice 
b^tniiisiDitter depends on the medium and distance through wfaidi the^d^ is 
5 tS^^ia; In application to TETRA, the transmitter will be that^^^l^fio 
b^^;station or that in the user^s portable or mobile radio. 

T^£dQowing points should be noted in coimection with the invention: 
(i^^iW indention relates to di£ferential image compression based on *on-oS! 

10 t e^B giqi^^ to the invention^ the comparison between a blo^^j^xi 

tl^ p^^ frame and the corresponding block from the previous frame is done 
^i^g^feti^^ pre-dequantisation DCT coefficient space. 
(i^^pi^ tiie quantisation steps vary for different DCT coeffidents^v^speidally 
w^p a4E^t^^ according to the hiunan visual sjrstem, the compariMd 

15 autdmi^^ more emphasis on DCT coefficients for which the ^ 

"^qpQ^^taon step is sm^ " f 7^^^ 

iCs^E^h^inethod and apparatus in accordance with the inventira^iie^^^ivk>us 
fi|^pi5^ed in pre-dequantisation DCT coefficient sp^/ This mii^^ it 
istiii^ fr^ was most recently compressed, or a block of that £rame; 

20 wlg d tiiyftdd comparison with newly arriving framefl or Hnrkgi nf fir flnriAQ 
l^e^ffia^ is updated eadi time a decision is made to encckl^ the iai^ 

arrive. This comparison technique saves the computation wldcji would 
hs^^een reiquired for dequantisation if the actual quantised coeffid^^^Siies 
ofWe^l^BS^ and previous frames had been used in the comiSariioSr^^^ 

25 (iv> M ih^ biiisic arrangement of the invention in accordance with fij^iw^S^pe 
ei^^^^ncoding is appUed only to the blocks for which significant chanties 
l^^!S?en 

(v) ^]^e;iblobk^ information is either separately encoded or multiplexed 

wi^cp^^e^ifi^^ 

30 (vij Alt^^ theoretically diflTerent, conyparison using pre-dequantization DCT 
co^^jCjtipiLW almost the^same compression performance as- : " 

coDctpOT^ tising actual DCT coefficients. The visual quality of the resultant 
in||PPp|Irtt6st indistinguishable for the two techniques. - y}^^^-^ 
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Claims 

1. A video compressor (DCT; Q; E), comprising: 

5 means for comparing present and previoxis video frames; whereby 

the means for comparing are adapted to make the comparison in quantised 
(DCT; Q) coefficient space. 

10 2. A video compressor (DCT; Q; E) according to daim 1, comprising 

an entropy decoder (E*0 for providing the data concerning the previous frame 
in quantised (DCT;Q) coefficient space. 

15 3. A video compressor (DCT; Q; E) according to claim 1 or daim 2, comprising 

transform means (DCT) for applying a DCT transform to blocks of the video 
frames; and 

20 quantising means (Q) for converting the output of the transform means into 
coefficients in quantised space. 

4. A video tr£insmission system (JPEG) comprising a video compressor (DCT; 
Q; E) in accordance with any previoxis daim and a data transmitter for 

25 transmitting the compressed data. 

5. A method of video compression (DCT; Q; E), comprising; 
comparing present and previous video frames; whereby 

30 

the comparison is made in quantised (DCT; Q) coeffident space. 
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Cf^method of video compression (DCT; Q; E) according to Haim 5, cicttfi^^ing 

tliS'stiep'of: 



j^^^q^i1±Le data concerning the present firame in quantised coefficient space 
5 l^i^t&opy decoding (E'^). ^^15^" 



Ti^method of video compression (DCT; Q; E) according to daim 5 or rlskim 6, 
coj^^ ising tile steps of: 



10 a^pSgaDCTto : 



qiMTitjfflTig (Q) the output of the transforming step into coefficLeoatsM otiM^ 

spficei i 



15 8. A method of video transmission (tJPEG) comprising perfomiing video" 

ccSijariBsai^ Q; E) in accordance with the method of any of dsdinis 5^7 
ai^ljpaismittm^ the compressed data. 
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